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© Coding apparatus. 



© A hierarchizatlon circuit (80) hierarchizes a conversion coefficient from a DCT circuit (13) to give the same to 
a quantization circuit (81). The hierarchization circuit (80) does not transmit a conversion coefficient of an AC 
coefficient regarding a hierarchy 2 x 2. Accordingly, rate control of the hierarchy 2 x 2 .s not performed by the 
quanlSn circuit (81). It is possible to reduce a code amount of the hierarchy 2 x 2. Thus, a prediction error m 
the lower layer is reduced so that coding efficiency is improved. Further, an image quality of an upper layer is 
improved. 
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BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to a coding apparatus for hierarchizing an image signal to code the same. 

2. Related Art And Prior Art Statement 

In recent years, digital compression of an image has been considered. Particularly, regarding high- 
efficiency coding which uses a DCT (discrete cosine conversion), various kinds of standardizations have 
been proposed. A high-efficiency coding technique is that image data are coded at smaller bit rate .n order 
to improve efficiency of digital transmission, recording and the like. The DCT processing .s that a single 
frame is divided into a plurality of blocks (m pixels x n horizontal scanning lines), and an image signal is 
converted to a frequency component in the block unit, to thereby curtail or reduce redundancy in a direction 
of a spatial axis. In the high-efficiency coding, not only compression (intra-frame compression) due to the 
DCT is performed within the single frame, but also inter-frame compression is also used m which correlation 
between the frames is utilized to reduce the redundancy in a direction of a time axis. The inter-frame 
compression is that such a property that general animation images resemble well to each other at forward 
and rearward frames is utilized to find a difference between the forward and rearward frames, to thereby 
DCT-orocess a difference value, to further reduce the bit rate. 

Fig. 10 is a block diagram showing a related art of a coding apparatus which uses such high-efficiency 

'"""'A^luminance or intensity signal Y and color difference signals Cr and Cb are given to a multiprocessing 
circuit 11 and are multiplied by a block unit of m pixels x n horizontal scanning lines. For example 
reoardinq'the color difference signals Cr and Cb. a sampling rate in a horizontal direction is brought to 1/2 
of the intensity signal Y. In this case, the color difference signals Cr and Cb are sampled in a single block 
of m x n during a period of time in which two (2) intensity blocks of m x n are sampled. The 
mullTprocessing circuit 11 forms a macroblock by four (4) blocks including two (2) intensity blocks Y and 
one of each of the color difference blocks Cr and Cb. In this connection, two (2) intensity blocks Y and one 
of each of the color difference blocks Cr and Cb express the same position on the image. An output from 
the multiprocessing circuit 1 1 is given to a DCT circuit 13 through a subtracter 12- 

In a case where intra-frame compression is performed, a switch 14 is turned OFF to be descnbed 
subsequently The output from the multiprocessing circuit 11 is inputted to the DCT circuit 13 as it is. A 
sional in which a single block is formed by m x n pixels is inputted to the DCT circuit 13. The DCT circuit 
13 converts the input signal to a frequency component by two-dimensional DCT (discrete cosine conver- 
sion) processing of m x n. Thus, a spatial correlation component can be deleted. Specifically, the output 
(conversion coefficiem) from the DCT circuit 13 is given to a quantization circuit 15. The quantization circuit 
15 re-quantizes the conversion coefficient by a predetermined quantization coefficient, to thereby reduce 
redundancy of a signal of a single block. In this connection, block pulses are supplied to the multiproces- 
sing circuit 11 the DCT circuit 13. the quantization circuit 15 and the like which operate in a block unit. 

Quantization data from the quantization circuit 15 are given to a variable-length coding circuit 16. and 
are Hafman-coded. for example, on the basis of the result calculated or computed from a statistical amount 
of coding of the quantization output. Thus, a short bit is allocated to data which are high in occurrence 
orobabilitv while a long bit is allocated to data which are low in occurrence probability, to thereby further 
reduce an* amount of transmission. In this manner, there can be produced a coding output which is 
compressed in intra-frame, from the variable-length coding circuit 16. 

The output from the variable-length coding circuit 16 is given also to a coding-amount control circuit 18. 
An amount of data of the output data varies largely depending upon an inputted image. In view of this, the 
code-amount control circuit 18 monitors an amount of output data from the variable-length coding circuit 16, 
and controls the quantization coefficient of the quantization circuit 15. to regulate the amount of output data. 
Further, there is also a case where the code-amount control circuit 18 controls the variable-length coding 
circuit 16 to control or limit the amount of output data. 

Meanwhile in a case where the switch 14 is turned ON. a signal of the present or reference frame from 
the multiprocessing circuit 11 is subtracted from data of the previous frame which is compensated for 
motion to be described subsequently in the subtracter 12. and is given to the DCT circuit 13. Specifically, in 
this case the inter-frame coding is performed which utilizes redundancy of the image between the frames 
to code difference data. In the inter-frame coding, if a difference between the previous frame and the 
reference frame is merely found, the difference increases in a case where there is motion in the image. In 
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view of this, the arrangement is such that a position of the previous frame corresponding to a predeter- 
mined position of the reference frame is found to detect the motion vector, and a difference is found at a 
pixel position corresponding to the motion vector to thereby perform motion compensation to reduce a 

difference value. ■ •. oh 

5 Specifically, an output from the quantization circuit 15 is given also to a reverse quantization circuit 21. 
The quantization output is reversely quantized in the reverse quantization circuit 15. Moreover, the 
quantization output is reversely DCT-processed in a reverse DCT circuit 22 so as to be returned to an 
original image signal. In this connection, in the DCT processing, the re-quantization, the reverse quantization 
and the reverse DCT processing, it is impossible to reproduce perfectly the original Information. A part of 

,0 the information is lacking. In this case, since the output from the subtracter 12 Is difference Information, the 
output from the reverse DCT circuit 22 is also difference information. The output from the reverse DCT 
circuit 22 is given to an adder 23. An output from the adder 23 Is fed back through a variable delay circuit 
24 for delaying a signal during about a single frame period of time and a motion correcting circuit 25. The 
adder 23 adds difference data to data of the previous frame to reproduce data of the reference frame, to 

J5 thereby output the reproduced data to the variable delay circuit 24. 

The data of the previous frame from the variable delay circuit 24 and the data of the reference frame 
from the multiprocessing circuit 11 are given to a motion detecting circuit 26 to detect the motion vector. 
The motion detecting circuit 26 finds the motion vector by total-search type motion detection due to, for 
example, matching calculation or computation. In the total-search type motion detection, the reference 

20 frame is divided into predetermined blocks, and a search range of horizontal fifteen (15) pixels x vertical 
eight (8) pixels, for example, is set by each of the blocks. The matching calculation or computation is 
performed within a search range corresponding to the previous frame every blocks, and approximation 
between the patterns is computed. The block of the previous frame which gives the minimum strain or 
distortion within the search range is computed. A vector produced by the block of the reference frame is 

25 detected as a motion vector. The motion detection circuit 26 outputs the found motion vector to the motion 

correcting circuit 25. , j , • ■» 

The motion correcting circuit 25 extracts data of a corresponding block from the variable delay circuit 
24 to perform correction in accordance with the motion vector. The motion correcting circuit 25 outputs the 
correction to the subtracter 12 through the switch 14 and outputs the correction to the adder 23 after time 

30 adjustment or regulation. Thus, the data of the previous frame compensated in motion are supplied from the 
motion correcting circuit 25 to the subtracter 12 through the switch 14. The subtracter 12 gives a prediction 
error to the DCT circuit 13. In this manner, when the switch 14 is turned ON. it becomes an inter-frame 
compression mode. When the switch 14 is turned OFF, it becomes an intra-frame compression mode. 

Tuming-ON and -OFF of the switch 14 are performed on the basis of a motion judgment signal. 

35 Specifically, the motion detection circuit 26 creates the motion judgment signal by the fact as to whether or 
not the dimension of the motion vector exceeds a predetermined threshold value to output the same to a 
logical circuit 27. The logical circuit 27 controls tuming-ON and -OFF of the switch 14 by logical judgment 
using the motion judgment signal and a refresh periodic signal. The refresh periodic signal is a signal which 
indicates an inter-frame compression frame I. In a case where it is indicated by the refresh periodic signal 

40 that the frame I is inputted, the logical circuit 27 tums OFF the switch 14 regardless of the motion judgment 
signal. Furthermore, if it is indicated that the motion is relatively fast, and the minimum distortion due to the 
matching computation exceeds the threshold value by the motion judgment signal, even in a case where 
the frame P is inputted, the logical circuit 27 turns OFF the switch 14 to perform intra-frame compression 
coding in the unit of blocks. ON- and OFF-controls of the switch 14 due to the logical circuit 27 are shown 

45 In the below table 1 : 

TABLE 1 



FRAME 1 


INTRA-FRAME COMPRESSION FRAME 


SWITCH 14 OFF 


FRAME P 


MOTION VECTOR DETECTION INTER-FRAME COMPRESSION FRAME 


SWITCH 14 ON 


MOTION VECTOR UNKNOWN INTRA-FRAME COMPRESSION FRAME 


SWITCH 14 OFF 



50 



55 Fig. 11 is a block diagram showing a decoding unit. 

On the side of decoding, the coding signal is given to a variable-length decoding circuit 33 through a 
code buffer memory circuit 32. The variable-length decoding circuit 33 decodes the inputted coding signal 
to fixed-length data. In this connection, the code buffer memory circuit 32 may be omitted. 



3 
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An output from the variable-length decoding circuit 33 is reversely quantized in a reverse quantization 
circuit 34 and is reversely DCT-processed in a reverse DCT circuit 35 so as to be decoded into an onginal 
image signal to give the same to a terminal a of a switch 36. Meanwhile, an output from the variable-length 
decoding circuit 33 is given also to a header-signal extracting circuit 37. The header-signal extracting circuit 
37 retrieves a header which indicates whether the inputted data are intra-frame compression data or inter- 
frame compression data, to output the retrieval to the switch 36. In a case where the header indicating the 
intra-frame compression data is given, the switch 36 selects the terminal a to output decoding data from the 

reverse DCT circuit 35. . . 

The inter-frame compression data are produced by addition of the output from the reverse DCT circuit 
35 and the output of the previous frame from a prediction decoding circuit 39 by an adder 38. Specifically, 
the output from the variable-length decoding circuit 33 is given to a motion-vector extracting circuit 40 to 
find a motion vector. The motion vector is given to the prediction decoding circuit 39. Meanwhile, the 
decoding output from the switch 36 is delayed in a single frame period of time by a frame memory 41. The 
prediction decoding circuit 39 compensates in motion for the decoding data of the previous frame from the 
frame memory 41 by the motion vector and outputs the same to the adder 38. The adder 38 adds the 
output from the prediction decoding circuit 39 and the output from the reverse DCT circuit 35 to each other 
to thereby decode the data compressed in inter-frame to output the same to a terminal b of the switch 36. 
When the inter-frame compression data are inputted, the switch 36 selects the terminal b by the header to 
output the decoding data from the adder 38. In this manner, compression and extension operations are 
performed without delay by both modes including the intra-frame compression and the inter-frame 

'^^'^By^the'way as described previously, the DCT circuit 13 orthogonally transforms the input signal by the 
two-dimensional DCT processing to output the conversion coefficient. The conversion coefficients from the 
DCT circuit 13 are successively arranged from the horizontal and vertical low-frequency component to high- 
frequency component. For example, if processing is performed in the unit of blocks of 8 x 8 pixels, sixty- 
four (64) conversion coefficients of 8 x 8 are generated which are arranged successively from the low range 
toward the high range horizontally and vertically. The conversion coefficients have a single DC coefficient 
and sixty-three (63) AC coefficients which indicate a mean value of all the data, and are scanned in zig-zag 
in the order from the horizontal and vertical low ranges toward the high range, that is, from the DC 

coefficients and are read out. 

In a case of a relatively coarse pattern, a value of a high-range component of the conversion 
coefficients is small so that a quantization output from the high-range component becomes 0 (zero). 
Specifically even if only the low range of the conversion coefficients is transmitted, it is possible to 
reproduce a rough or general image. By transmission of the high-range component, it is possible to 
reproduce a fine or detailed image. Furthermore, in a case where the conversion coefficients are reversely 
converted there can be produced reproduced images of the number of pixels in accordance with the 
number of conversion coefficients. Specifically, if only the low range of the conversion coefficients is 
reversely converted, the reproduced images of the respective blocks become reduced images in accor- 
dance with the number of conversion coefficients. Accordingly, in consideration of a case where it is 
impossible to set a sufficient transmitting rate, a case where only a part of the bit stream is used for 
reproduction like a special reproduction in a VTR. a case where a part of the bit stream is used to perform 
small-image-plane display, or the like, there is a way to use a method of hierarchizing the conversion 
coefficients to quantize the same. ^. io/=\ <.k«. o 

Figs 12(a) 12(b) and 12(c) are explanatory views for describing the hierarchization. Fig. 12(a) snows 
hierarchy (hereinafter referred to as "hierarchy 2 x 2") which codes a portion (a diagonal portion) of 2 x 2 of 
the low range of each of the blocks, and Fig. 12(b) shows hierarchy (hereinafter referred to as "hierarchy 4 
X 4") which codes a portion (a diagonal portion) of 4 x 4 of the low range of each of the blocks, while Fig. 
12(c) shows hierarchy (hereinafter referred to as "hierarchy 8 x 8") which codes a portion (a diagonal 
portion) of 8 X 8 of the entire range of each of the blocks. 

In the hierarchy 2 x 2. as shown by the diagonal in Fig. 12(a). the conversion coefficient of 2 x 2 in the 
low range is used which includes the DC coefficient of the coefficients of 8 x 8. These four (4) conversion 
coefficients are quantized and. further, are coded in variable length so as to be outputted. In the hierarchy 4 
X 4 quantization is performed up to the conversion coeKicient of 4 x 4 of the low range to code, in variable 
length the conversion coeHicient. to thereby be outputted together with the coding output of hierarchy 2 x 
2 Similarly in the hierarchy 8x8. the conversion coefficients of the entire areas or total regions are 
quantized and are coded in variable length, and are outputted together with the coding output of the 
hierarchy 2 x 2 and the hierarchy 4x4. For example, in accordance with the transmitting rate, it is decided 
whether transmission is made up to the hierarchy 2 x 2, whether transmission is made up to the hierarchy 4 
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X 4 or whether transmission is made up to the hierarchy 8x8. 

Meanwhile, on the side of decoding, it is possible to reproduce the image with details in accordance 
with the fact up to what hierarchies the image is decoded. For example, in a case where the coding output 
of the hierarchy 2 x 2 is decoded, it is possible to reproduce a relatively coarse image. In a case where it is 
used for decoding up to the decoding output of the hierarchy 8 x 8, it is possible to reproduce a detailed or 
fine image. 

Fig. 13 is a block diagram showing a related art of a coding apparatus in which coding is hierarchized in 
this manner. Fig. 14 is a block diagram showing a specific arrangement of the quantization circuit in Fig. 13. 
Moreover, Figs. 15(a), 15(b) and 15(c) are explanatory views showing an example of zig-zag scanning every 
hierarchies. Figs. 16 and 17(a), 17(b) and 17(c) are explanatory views for describing coding every 
hierarchies. 

The coding apparatus illustrated in Fig. 13 gives an output from a OCT circuit 13 to a hierarchization 
circuit 50. An output from the hierarchization circuit 50 is given to a quantization circuit 51 . The quantization 
circuit 51 subtracts a conversion coefficient, for example, by a predetermined quantization coefficient, to 
thereby produce a quantization output to output the same to a variable-length coding circuit 52. Further- 
more, the quantization circuit 51 finds also a reverse quantization output of a quantization output to output 
the same to a reverse DCT circuit 22. The coding output from the variable-length coding circuit 52 is given 
to a coding control circuit 53. The coding control circuit 53 controls the quantization coefficient of the 
quantization circuit 51 on the basis of a coding amount of the coding output and controls the variable-length 
coding circuit 52 to suppress the total or sum code amount to a value within a set code amount. 

Now. it is assumed that the DCT circuit 13 performs two-dimensional DCT conversion in a block unit of 
8x8 pixels. Sixty-four (64) conversion coefficients from the DCT circuit 13 are given to the hierarchization 
circuit 50 to output the conversion coefficients every hierarchies. The hierarchization circuit 50 outputs the 
four (4) conversion coefficients of 2 x 2 of the low range as the conversion coefficient output d(2 x 2) of the 
hierarchy 2x2. Specifically, the hierarchization circuit 50 outputs the DC coefficient and three (3) AC 
coefficients. Similarly, the hierarchization circuit 50 outputs sixteen (16) conversion coefficients of the low 
range as the conversion coefficient output d(4 x 4) of the hierarchy 4 x 4. and outputs sixty-four (64) 
conversion coefficients as the conversion coefficient output d(8 x 8) of the hierarchy 8x8. 

Now, it is assumed that the conversion coefficients from the DCT circuit 13 are those as shown in Fig. 
16. The hierarchization circuit 50 gives the conversion coefficient outputs d(2 x 2). d(4 x 4) and d(8 x 8) 
respectively to a quantization unit 55 and subtracters 57 and 61 (Fig. 14) of the quantization circuit 51. The 
conversion coefficient output d(2 x 2) of the hierarchy 2x2 becomes that as shown in the left column in 
Fig. 17(a). The quantization unit 55 quantizes the conversion coefficient d(2 x 2) to output the same. For 
example, it is assumed that the quantization unit 55 quantizes the conversion coefficient output d(2 x 2) by 
150. A quantization output q(2 x 2) from the quantization unit 55 is brought to DC, 1. 1 and 0 shown in a 
central column in Fig. 17(a). 

The quantization circuit 51 is so arranged as to output also a reverse quantization output. A reverse 
quantization unit 56 quantizes, in reverse, the quantization output q(2 x 2) to output the same. Specifically, 
the reverse quantization unit 56 outputs a reverse quantization output b(2 x 2) (DC, 150, 150. 0) (a right- 
hand column in Fig. 17(a)) which 150 times the quantization output q(2 x 2). The reverse quantization output 
b(2 X 2) is given to the subtracter 57 and an adder 60. 

In the next hierarchy 4x4. quantization should be performed regarding twelve (12) conversion 
coefficients except four (4) conversion coefficients which originally perform coding at the hierarchy 2 x 2. If 
doing so. however, in a case where decoding is performed at a level of the hierarchy 4x4, the reverse 
quantization output with respect to the hierarchy 2 x 2 is used regarding the coding output on the basis of 
the four (4) conversion coefficients of the low range. A quantization error appears in a decoding output in 
this hierarchy. In view of this, the arrangement is such that, regarding the four (4) conversion coefficients in 
the low range of the hierarchy 4x4, the reverse quantization output of the hierarchy 2 x 2 is used to predict 
an actual conversion coefficient. Specifically, the arrangement is such that, regarding the four (4) conversion 
coefficients of the low range, the reverse quantization output of the hierarchy 2 x 2 is used as a prediction 
value, and a difference between the actual conversion coefficient and the prediction value is quantized. 
Specifically, the reverse quantization output b(2 x 2) of the reverse quantization unit 56 is given to the 
subtracter 57 and is subtracted from the conversion coefficient output d(4 x 4). In this manner, a conversion 
coefficient indicated in the left-hand column in Fig. 17(b) is inputted to a quantization unit 58. 

The quantization unit 58 quantizes the inputted conversion coefficient by, for example, ten (10) to output 
the quantization output q(4 x 4) indicated at the central column in Fig. 17(b) to the variable-length coding 
circuit 52 and a reverse quantization unit 59. The reverse quantization unit 59 multiplies ten (10) to the 
quantization output to output the same to the adder 60. Four (4) low-range components of the reverse 
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26 



quantization output from the reverse quantization unit 59 are ones in which the quantzatjon output o a 
difference between the actual conversion coefficient and the reverse quantization output b(2 x 2) of the 
hierarchy 2 x 2 is reversely quantized. Accordingly, in order to be returned to the original conversion 
coefficient, the adder 60 adds the output from the reverse quantization unit 59 and the reverse quantization 
output b(2 X 2) to each other. In this manner, there can be produced the reverse quantization output b(4 x 4) 
of the hierarchy 4x4 (the right-hand column in Fig. 17(b)). , , ♦•^o the 

Also in the next hierarchy 8 x 8. In order to reduce the decoding error due to the quantization error he 
subtracter 61 finds a difference between a prediction value and the conversion coefficient output d(8 x 8) of 
the hierarchy 8 x 8. with the reverse quantization output b(4 x 4) serving as the predic^on value ( he left- 
hand column in Fig. 17(c)). A quantization unit 62 quantizes the output from the adder 61 by five (5). and 
finds the quantization output q(8 x 8) indicated in the right-hand column in Fig. 17(c) to output the same to 
the variable-length coding circuit 52 and a reverse quantization unit 63. The reverse quantizaton unit 63 
multiplies five (5) to the quantization output q(8 x 8) to give the reverse quantization output to an adde^ 64^ 
The adder 64 adds the reverse quantization output b(4 x 4) to the reverse quantization output to correct the 
same, and to output the reverse quantization output b(8 x 8) of the hierarchy 8 x 8 to the reverse DCT 

*"'^Thf variable-length coding circuit 52 reads out the quantization output in the order of the number in Fig. 
15 every hierarchies, that is. in the order of zig-zag scanning from the low range toward the high range in 
the horizontal and vertical directions, to code, in variable length, the quantization output every h^rarchies to 
output !he same. For example, regarding the hierarchy 2 x 2. the variable-length coding circuit 52 reads ou 
four (4) quantization coefficients of the quantization output b(2 x 2) in the order of the nurnber in Fig. 5(a) 
to code the same. Similarly, the variable-length coding circuit 52 reads out sixteen (16) outputs of the 
quantization output b(4 x 4) in the order of the zig-zag scanning indicated by the number m Fig. 15(b) to 
2ode the same, in the hierarchy 4 x 4. while, in the hierarchy 8 x 8. the variable-length coding circuit 52 
reads out sixty-four (64) outputs of the quantization output b(8 x 8) In the order of the number m Fig. 15(c) 
to code the same. In this connection, the variable-length coding circuit .52 reduces the redundancy by 
entropy coding such as. for example, Hafman coding, run-length coding or the like. 

The run-length coding is that the coefficient read out in the order of zig-zag scanning is converted to 
the consecutive number of the same code, to thereby reduce the redundancy. The Hafman coding is that, 
for example, the number in which 0 (zero) that is the coefficient the highest in appearing frequency .s 
consecutive (hereinafter referred to as "zero-run") and a non-zero coefficient appearing the next of 0 (zero) 
cooperate with each other to form a set, and a code is allocated to the set of data in accordance with the 
appearing frequency thereof. Specifically, in the Hafman coding, a Hafman coding table 
appearing frequency of data of a set of zero-run and non-zero coefficient is used and the highe the 
appearing frequency, conversion is made to a code short in coding amount. Accordingly, .n the Hafman 
coding, the larger the zero-run. the number of code words is reduced, and coding at high efficiency is 

performed^^ control circuit 53 finds a code amount of the coding output from the variable-length coding 
circuit 52 every hierarchies. The coding control circuit 53 accumulates the generated code amount every 
hierarchies In consideration of the set code amount and the generated code amount allocated to the 
hierarchies the coding control circuit 53 determines or decides quantization widths of the respective 
hierarchies Thus, the quantization coefficient set every hierarchies is given to the quantization units 55. 58 
and 62 of the quantization circuit 51 . and the code amount is controlled every hierarchies. 

Fig. 18 is a block diagram showing a decoding unit which decodes the coding output which is coded in 

45 a manner of hierarchy. . , 

The coding output which Is inputted through a code buffer memory circuit 32 is given to a vanable- 
lenoth decoding circuit 70. The variable-length decoding circuit 70 decodes. In variable length, the coding 
outputs every hierarchies. The variable-length decoding output Is given to a reverse quantization circuit 71 
under the original matrix scanning. The reverse quantization circuit 71 reversely quantizes the variable- 

50 length decoding output to reversely hierarchize the same. Fig. 19 Is a block diagram showing a specific 
arrangement of the reverse quantization circuit 71. 

The variable-length decoding outputs r(2 x 2), r(4 x 4) and r(8 x 8) every hierarchies from the variable- 
length decoding circuit 70 are given respectively to reverse quantization units 75. 76 and 77 of the reverse 
Quantization circuit 71. The reverse quantization unit 75 reversely quantizes the decoding output r(2 x 2). 

65 Thus there can be produced the reverse quantization output s(2 x 2) which corresponds to the reverse 
Quantization output b(2 x 2) of the hierarchy 2 x 2 on the side of coding. The reverse quantization output s(2 
X 2) from the reverse quantization unit 75 Is outputted to an adder 78. The variable-length decoding output 
r(4 X 4) of the hierarchy 4 x 4 is reversely quantized by the reverse quantization unit 76. The reverse 



30 



35 



40 



6 



EP 0 593 013 A2 



quantization output s(2 x 2) of the hierarcliy 2 x 2 is added to the reverse quantization output from the 
reverse quantization unit 76. whereby there is produced a reverse quantization output s(4 x 4) of the 
hierarchy 4x4 corresponding to the reverse quantization output b(4 x 4) on the side of decoding. The 
reverse quantization output s(4 x 4) is given to an adder 79. Moreover, the variable-length decoding signal r- 

6 (8x8) of the hierarchy 8 x 8 is given to the reverse quantization unit 77 so as to be reversely quantized. 
The reverse quantization unit 77 and the reverse quantization output s(4 x 4) of the hierarchy 4 x 4 are 
added to each other by the adder 79. so that there is produced the reverse quantization output s(8 x 8) of 
the hierarchy 8x8 corresponding to the reverse quantization output b(8 x 8) on the side of transmission. 
Any one of the reverse quantization outputs s(2 x 2). s(4 x 4) and s(8 x 8) is given to a reverse OCT circuit 

10 72. in accordance with the hierarchy transmitted, and in accordance with the hierarchy which is intended to 

be displayed. ^ * ^ 

The reverse DCT circuit 72 processes, in reverse DCT. the inputted reverse quantization output and 
returns the same to the original data, to give the same to a terminal a of a switch 36. In a case where the 
reverse DCT circuit 72 processes, in reverse DCT, the reverse quantization output of the hierarchy 2 x 2 or 
J5 the hierarchy 4 x 4. an AC component of the high range having no effective data is processed as 0 (zero). 
In this connection, in a case where the reverse DCT circuit 72 uses the inputted coding output to small- 
image-plane display, the reverse DCT circuit 72 performs the DCT processing on the basis of the 
dimension of the image planes corresponding respectively to the hierarchies. Furthermore, in this case, a 
prediction decoding circuit 73 performs prediction decoding in accordance with the image-plane size 

20 displayed. , . . 

By the way. as described previously, the coding control circuit 53 decides the quantization widths every 
hierarchies so as to be contented within the code amount set every hierarchies. Accordingly, it is also 
possible that, for example, the setting rate of the hierarchy 2x2 that is the first layer is set lower than the 
other hierarchies in view of restriction of a transmitting path. Meanwhile, in coding of the hierarchy 2x2. 

26 decoding cannot be performed even if additional information and motion information are not transmitted in 
addition to image information of the DC component and the AC component. In a case where the setting rate 
of the hierarchy 2x2 cannot be taken large sufficiently, there may be a case where the code amounts of 
these additional information, motion information and the like approach the setting rate. For example, in a 
case where the code amount of the motion information is relatively large, or the like, there is no room to 

30 transmit the image information so that the rate control is made difficult. In this case, if the quantization width 
increases in order to suppress the code amount within the setting rate, it is almost impossible to transmit 
the AC component. ». . . 

Also in this case, for a value large in the AC coefficient of the low range of the conversion coefficient, 
that is for the image in which the power of the AC coefficient is large as compared with the power of the 

36 general image, the quantization output does not become 0 (zero) even if the quantization width is large so 
that the AC component is transmitted. In this case, the quantization output of the AC coefficient transmitted 
by the first layer is extremely large in quantization error. For this reason, at a lower layer subsequent to the 
first layer (the hierarchy on the side of the high range), a difference of the low-range coefficient increases 
so that coding efficiency is deteriorated, in spite of the fact that the low-range coefficient has already been 

40 coded at the first layer. 

The problem will hereunder be described by an example illustrated in Figs. 17(a). 17(b) and 17(c). 
It is assumed that the quantization coefficient is limited to a value of 1 to 150. Now. it is assumed that 
the setting rate of the hierarchy 2x2 that is the first layer is near the number of transmitting bits of the 
information other than the image information, and the quantization width of the hierarchy 2 x 2 is 150 of the 

45 maximum value as shown in Fig. 17(a). The quantization output is given to the variable-length coding circuit 
52. and data of the combination of the zero-run and the non-zero coefficient are coded in variable length. 
Specifically, the code transmitted in the hierarchy 2 x 2 are three (3) including DC. 1 and 1. 

In this manner, even if the quantization width increases, the AC component is transmitted, because 
there is a large or high power in the AC low-range coefficient. Thus, it becomes difficult to control, in rate. 

so the first layer to the setting rale. . , u- u 

Further, in view of the fact that the quantization error of the reverse quantization output of the hierarchy 
2 X 2 is large, the difference value used as the low-range coefficient of the hierarchy 4x4 becomes a 
relatively large value. In spite of the fact that the AC component is transmitted at the hierarchy 2x2, the 
low-range coefficient of 2 x 2 does not become 0 (zero) even if the low-range coefficient of 2 x 2 is 

66 quantized by ten (10) (central column in Fig. 17(b)). The code which is coded, in variable length, by the 
hierarchy 4 x 4 is {0. - 7}. {-5}. {2}. {4}, {3}, {1}. {2}. {2}. {1}. {1} and {1}. In this connection. {} 
indicates combination of the zero-run and the non-zero coefficient in the Hafman coding. Specifically, the 
low-range coefficient of 2 x 2 which has already been transmitted at the hierarchy on the side of the low 
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range must also be transmitted again, and the coding efficiency is deteriorated in the lower layer (the 
hierarchy 4 x 4 and the hierarchy 8x8 subsequent to the first layer (hierarchy 2 x 2). 

Similarly, the code coded, in variable length, in a case where the quantization coefficient Is five (5) in 
the hierarchy 8 x 8 is {1}, {1}, {(0x2). - 1}, {0, - 1}. {- 1}, {1}. {2}. {(0x2), 1}, {0, 1}. {1}, {1}. {1}. {1}. 

5 {1} and {(0x3), 1}. tn this connection, (Oxn) indicates that 0 (zero) Is continuous through n. 

As described previously, the Hafman code allocates a single code word to the set of the zero-run and 
the non-zero coefficient which appears subsequently. Accordingly, the number of code words of the AC 
component of the hierarchy 2x2. the hierarchy 4 x 4 and the hierarchy 8x8 becomes two (2) code words, 
eleven (11) code words and fifteen (15) code words, respectively. Specifically, the number of code words of 

70 the transmitted AC component is many to be two (2) code words up to the hierarchy 2x2, thirteen (13) 
code words up to the hierarchy 4 x 4 and twenty-eight (28) code words up to the hierarchy 8x8. Thus, it 
will be seen that the coding efficiency is low. 

The power of the conversion coefficient of the first layer Is high or large depending upon the property of 
the Image. For this reason, as described previously, the setting code amount and the generated code 

76 amount of the first layer approach to each other so that the coding efficiency is deteriorated. 

Further, in a case where the coding output on the basis of the first layer is reproduced, it is unnecessary to 
transmit the motion vector corresponding to the entire region. However, in consideration of the fact that the 
coding output on the basis of the hierarchy other than the first layer is reproduced, the entire information of 
the unnecessary motion vector Is transmitted at the first layer. Thus, there is also a problem that the coding 

20 efficiency Is low. 

By the way, conversely, depending upon setting, there is a case where a sufficient code amount Is 
given to the first layer. In also this case, it is not limited that the setting rate up to the hierarchy subsequent 
to the first layer is sufficiently large or high, but there Is a case where the quantization width of the lower 
layer must increase extremely. Then, it Is impossible to sufficiently transmit the information of the 

25 coefficient of the hierarchy on the side of the high range which is not coded in the hierarchy on the side of 
the low range, so that it Is Impossible to produce a sufficient image quality In the hierarchy on the side of 
the high range. On the contrary, a sufficient code amount Is given to the hierarchy on the side of the low 
range (low-range coefficient) so that a superior or satisfactory image quality is secured. Thus, the Image 
quality becomes unbalance between the hierarchy on the side of the upper range and the hierarchy on the 

30 side of the lower range. 

For example, In a case where the setting rate of the hierarchy 2x2 that is the first layer Is sufficiently 
large so that the code amount capable of being used In the AC component is extremely large, the coding 
control circuit 53 is such that the quantization width of the hierarchy 2 x 2 is sufficiently reduced, and the 
low-range coefficient Is coded by the sufficient code amount and is transmitted. In this case, the 

35 quantization error of the hierarchy 2 x 2 Is extremely small, and a difference value of the low-range 
coefficient of 2 x 2 in the quantization of the hierarchy 4x4 becomes substantially 0 (zero). However, at the 
hierarchy 4x4, the coefficient which is not coded by the first layer must be coded by the code amount 
which Is based on a difference between the setting rate up to the hierarchy 4 x 4 and the setting rate of the 
hierarchy 2 x 2. In a case where the code amount based on the rate difference is small, It Is required that 

40 the quantization width increases extremely in order to suppress the coefficient which is not coded at the 
first layer, within the setting rate. Thus, the AC coefficient which is relatively small becomes 0 (zero) and Is 
not transmitted. 

Then, there is a case where the high-range (middle range) AC coefficient does not almost exist In the 
decoding output of the hierarchy 4 x 4 so that it Is impossible to produce a sufficient image quality. Further, 
45 the image quality of the reproduced image becomes unbalance between the hierarchy 4 x 4 and the 
hierarchy 2x2. 

In connection with the above, the same Is applicable also In a case where the setting rate of the 
hierarchy 4 x 4 Is large, and the setting rate up to the hierarchy 8 x 8 is not sufficiently large with respect to 
the setting rate up to the hierarchy 4x4. Thus, the image quality of the hierarchy 8 x 8 Is deteriorated. 
50 Moreover, the Image quality of the reproduced Image up to the hierarchy 4 x 4 and the image quality of the 
reproduced image up to the hierarchy 8x8 become unbalance. 

This problem will hereunder be described with reference to Fig. 20 and Figs. 21(a). 21(b) and 21(c). 
Figs. 21(a) to (c) correspond respectively to Figs. 17(a) to (c). 

It is now assumed that the conversion coefficient Illustrated In Fig. 20 is outputted from the DCT circuit 
55 13. The hierarchlzatlon circuit 50 gives a conversion coefficient d(2 x 2) indicated on the left column In Fig. 
21(a) to the quantization circuit 51. A quantization width is limited to a value between one (1) and sixty-four 
(64). It Is assumed that a setting rate of the hierarchy 2x2 that is the first layer is sufficiently large so that 
the quantization coefficient of the hierarchy 2 x 2 is set to one (1) that is the minimum. The quantization 
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central column in Fig. 21(a). Spec.f.caliy. .n this '^^^^^ ^^'Y^^gg ^^ere the setting rate ot the first layer 
and {9}. in this manner, operation is P^f°""^^J"^^^ of an AC low-range coefficient after 

t cffirientiv larqe the quantization width decreases to increase powo 
. Va^zr^Xebv Approach the code amount to t^ se >n9 ra.^ ^^^^ ^^^^^ ^^^^ 

In a case where a difference between the ^^"'"S ^^^^^^^ ^^e hierarchy 4 x 4 becomes large. In 

to the hierarchy 2 x 2 is relatively ^"^^ ; '^^^^ of the maximum value. In this case, a 

Figs 21(a). 21(b) and 21(c), the quantization width is sixty K ) 

code coded in variable length is {(0x3). 1} and {0. 1). ^^^e ^hich is coded 



10x2). 1}, {0. 1} and {1}. u u = .nr.m in the setting rate, since the quantization width 

^ i this manner, in the hierarchy 2 x 2 which width is extremely small, as 

is small, a quantization error ^^J^^Z""?!:^ Z^^^ « -P«"- Tl^^ 

,s indicated on the right column in Fig. 21(a). Thus, there can v ^ ^^^^ ^^^^^ ^.g^. 

he contrary, in the hierarchy 4 x 4 since 'l"^" '^^^^^^^^ are not sufficiently 

range (middle range) coefficient great power these quam^ ^^^^ ^^^^^^^^^^^ 

transmitted. Accordingly, as shown in the "9j*-*^^";^„^°'"J"^^ the right-hand column in Fig. 21(b) 

n high-range component. As will be f --;;^7/J,: Trep-duced image of the hierarchy 2 x 2 
.0 and the right-hand column in 2;aX rx ' Ts"^^^^ upon'reproduction. Specifically, the .mage 

and the reproduced image of the hierarchy J:, equalized to each other. 

qualities Of L reproduced images at the -pe^^^^^^^^^^ l^'XZ room in the setting code amount 

in connection with the above, in also ^^^^^^^T^ m a case where a difference between the 

at the hierarchy other than the first layer, ^t^^ ^^'"^^ '^^^^^^^^^^^^^ up to the hierarchy on the high range 
« setting code amount up to ^^ ^--^^^^^^^ oHhe high'range increases so that the image 

is small the quantization width of the hierarcny on u.o 

qualities of the respective layers are not ff** ° ,ollowing problems. Specifically, the low 

' ,„ this manner, the coding apparatus describe^^ rse«Tng Is of the respective layers. The coding 
rate control in the first layer f ^^^J^^^^ is Ttariorated. Moreover, the coding apparatus has 
30 efficiency in the hierarchy on f-f J^^^ ^t S^^^ ^^P"^*"^ ?; ' 

ISr::^^^^"^' ^^"^"^^ '''''' " 

each other. 

35 ipPTc; ANin SUMMARY OF THE INVENTION 

^^rararhroSeTof ^^^^^^^^^^^^ to provide a coding apparatus which improves coding e«iciency 

- ^r^aro:hro;^ '^^^^^^^^^ - pro^de a codmg apparatus which controls transmission of a 

anX; r rctTr invention to provide a coding apparatus which can equalize image 

qualities of reproduced images ^fj^^P^^";^^^^^^^^^^ apparatus comprising orthogonal transformation 

,5 According to the invention, there P o^'^^J^f coefficient having a direct-current 

n,eans for orthogonally transforming a ^^^^^^^'l^^^, h a arc^>i-t'on means for hierarchizing the 
component and a plurality of alternate-cu rent comp°"e^^ ^ hierarchies in accor- 

conversion coefficient from said orthogonal ^^^"^'^^^^^^^^^ oufput the hierarchized conversion 

dance with a frequency of said conver^on coeM 'component towa«i an nth layer (n is the integer 
60 coefficient from a first layer corresponding '^^^^^^^^^^ transmission means for controlling, in 

description. 



9 



EP 0 593 013 A2 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig 1 is a block diagram showing an embodiment of a coding apparatus according to the invention: 

Fia 2 is a block diagram showing a specific arrangement of a quantization circuit in Fig 1 

Fig 3 is an explanatory view for describing quantization inputs of respective hierarchies in the 

embodiment; ^-^^^t. 

Fig. 4 is an explanatory view for describing operation of the embodiment. 

Flo 5 is a block diagram showing a decoding unit; . •* • c. 

Fig 6 is a block diagram showing a specific arrangement of a reverse quantization circuit m Fig. 5. 

Fig 7 is a block diagram showing an another embodiment of the invention; 

Fig 8 is a block diagram showing an another embodiment of the invention; 

Fig 9 is an explanatory view for describing operation of the embodiment in Fig. 8; 

Fig. 10 is a block diagram showing a related art of a coding apparatus; 

Fig. 11 is a block diagram showing a decoding unit in Fig. 10; 

Fig 12 is an explanatory view for describing hierarchization; 

Fiq 13 is a block diagram showing a related art of the coding apparatus; 

Fig. 14 is a block diagram showing a specific arrangement of a quantization circuit in Fig. 13. 

Fiq 15 is an explanatory view for describing zig-zag scanning; 

Fig 16 is an explanatory view showing an example of a conversion coefficient; 

Fig. 17 is an explanatory view for describing operation of the related art; 

Fie 18 is a block diagram showing a decoding unit in Fig. 13; ■♦ •„Pi„io. 

Fig 19 is a block diagram showing a specific arrangement of a reverse quantization circuit m Fig. 18. 
Fig 20 is an explanatory view showing an example of a conversion coefficient: 
Fig 21 is an explanatory view for describing operation of the related art; 

Fia 22 is a block diagram showing an another embodiment of the invention; ... .. •„ pi„ 

Fig. % is a block diagram showing a specific arrangement of a motion-vector degeneration circuit in Fig. 

Ra 24 is a block diagram showing a motion-vector reproducing circuit on the side of decoding; 
Fig 25 Is a block diagram showing a motion-vector reproducing circuit on the side of decoding; and 
Fig. 26 is a block diagram showing a modification of the embodiment illustrated in Fig. 1. 

DETAILED DESCRIPTION OF THE PREFER RED EMBODIMENTS 

F.O 1 is a block diagram showing an embodiment of a coding apparatus according to the invention. In 
Fig. ^^he sLforSral reference numerals are applied to constitutional elements the same as or 

''"rin^nsnl^i^and'-coior difference signals Cr and Cb are inputted to a multiprocessing circuU 11^ 
Th/muS rocess no circuit 11 multiplexes an inputted signal in a block unit of eight (8) pixels x eight 8 
horizontal scanning imes^ of each of the color difference blocks Cr and Cb. to output the same to a 
2 11 0 a evi sTame -Inputted to the subtracter 12 through a switch 14. The subtracter 
2 ubtac ts the d^^^ Of the previous frame from an output of the multiprocessing circuit 11 to outpu^^the 
me t a D?? circuit 13 upon processing of inter-frame --P--'°- ^P°" P;^^,^^^^^^^^^^^ 
compression, the subtracter 12 outputs the output of the multiprocessing circuit 11 to the DOT circuit 13 as 

" " jhe DOT circuit 13 processes, in two-dimensional DOT of 8 x 8, an output from the subtracter 12 to 
outpu the'sam to a hLarchizat'ion circuit 80. The hierarchization circuit SO^;--^- J, ^^^^^^ 
coefficient from the DCT circuit 13 into a first to nthe layers (n is the integer equal to or more ^^^^n <2)V 
Fonxample^he hierarchization circuit 80 performs hierarchization into three 3) hierarchies .nclud.ng a 

espective hierarchies from the hierarchization circuit 80 are given to a quartiza^^on c rcurt 8 . 
respective niera arrangement of the hierarchization circuit 81 in Fig. 1. 

. c n e In ^efficients d(DC). d(4 x 4) and d(8 x 8) of -P^^u^^-^^^^^^^^^^ ^a 

respectively to subtracters 85, 85 and 89. The conversion coefficient d{DC) is outputted to a er^nmal 93 as 
rouam za U output q(DC) of the hierarchy 2 x 2. and to a terminal 94 as a reverse quantization output 
X 2 Te ubtra^^^^^^ 85 subtracts the conversion coefficient of the hierarchy 2 x 2 serving as a prediction 
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value from the conversion coefficient of the hierarchy 4 x 4, to give a difference therebetween to a 
quantization unit 86. The quantization unit 86 quantizes the inputted conversion coefficient of 4 x 4 to output 
the quantization output q(4 x 4) to a terminal 95 and a reverse quantization unit 87. The reverse quantization 
unit 87 reversely quantizes the quantization output q(4 x 4) to give the reverse quantization output to an 
adder 88. The adder 88 adds the reverse quantization output b(2 x 2) of the hierarchy 2 x 2 to the reverse 
quantization output to thereby correct the same, and outputs a reverse quantization output b(4 x 4) of the 
hierarchy 4 x 4 to a terminal 96, the subtracter 89 and an adder 92. 

The subtracter 89 subtracts the reverse quantization output b(4 x 4) from a conversion coefficient output 
d(8 X 8) to predict the conversion coefficient of the hierarchy 8 x 8, to thereby output a prediction value to a 
quantization unit 90. The quantization unit 90 quantizes the conversion coefficient to output a quantization 
output q(8 X 8) to a terminal 97 and a reverse quantization unit 91. The reverse quantization unit 91 
reversely quantizes the quantization output q(8 x 8) to give the same to the adder 92. The adder 92 adds 
the reverse quantization output b(4 x 4) of the hierarchy 4 x 4 to a reverse quantization output to produce 
the reverse quantization output b(8 x 8) of the hierarchy 8 x 8 to thereby output the same to a terminal 98. 

The quantization outputs q(DC), q(4 x 4) and q(8 x 8) from the quantization circuit 81 are given to a 
variable-length coding circuit 52. The variable-length coding circuit 52 is controlled by a coding control 
circuit 82 to convert the inputted data to a variable-length code every hierarchies, to thereby further reduce 
the bit rate to output the same. The variable-length code from the variable-length coding circuit 52 is also 
given to the coding control circuit 82. The coding control circuit 82 is so arranged as to output a control 
signal for varying the quantization coefficient every hierarchies, to the quantization units 86 and 90 of the 
quantization circuit 81, on the basis of the output from the variable-length coding circuit 52. Further, the 
coding control circuit 82 limits the number of output bits of the variable-length coding circuit 52 to limit the 
total code amount. In this connection, block pulses are supplied to circuits which perform processing m a 
block unit, such as the multiprocessing circuit 11. the DCT circuit 13, the quantization circuit 81 and the 
like 

The reverse quantization output b(8 x 8) of the quantization circuit 81 is given to a reverse DCT circuit 
22 The reverse DCT circuit 22 processes, in reverse DCT. the reverse quantization output, to retum the 
same to the original data prior to the DCT processing, to thereby output the same to an adder 23. The 
output from the adder 23 is fed back through a motion correction circuit 25 and a variable delay circuit 24 
for performing delay through a single frame period of time. The adder 23 adds difference data of the 
present frame and data of the previous frame to each other, to return the inputted data to the original data 
prior to the difference processing due to the subtracter 12 to output the same to the variable delay circuit 
24 An output from the variable delay circuit 24 Is given also to a motion detecting circuit 26. 

An output from the multiprocessing circuit 11 is also inputted to the motion detecting circuit 26. The 
motion vector is found by the matching calculation or computation due to detection of. for example, a total 
search type motion vector so as to output the same to the motion con-ecting circuit 25. A motion judgment 
signal on the basis of whether or not a distortion value due to the matching computation exceeds a 
predetermined threshold value is outputted to a logical circuit 27. The motion correcting circuit 25 corrects, 
in motion the output from the variable delay circuit 24, on the basis of the motion vector, and outputs the 
previous frame data corrected in motion to the subtracter 12 through the switch 14. The motion logical 
circuit 27 controls turnlng-on and turning-off of the switch 14 on the basis of the motion judgment signal and 
the refresh periodic signal which indicates the intra-frame compression frame. 

Rg. 5 is a block diagram showing the side of decoding. In Fig. 5. the same or identical reference 
numerals are applied to the same or identical constitutional elements as those in Fig. 18. 

A coding output of the variable-length coding circuit 52 on the side of coding Is given to a code buHer 
memory circuit 32. A coding output from the coding buffer memory circuit 32 is given to a variable-length 
decoding circuit 70. The variable-length decoding circuit 70 decodes, in variable length, the coding output 
every hierarchies 2 x 2. 4 x 4 and 8 x 8. to convert the same to fixed-length data r(DC), r(4 x 4) and r(8 x 
8), respectively. An output from the variable-length decoding circuit 70 Is given to a reverse quantization 
circuit 100. a header-signal detecting circuit 37 and a motion-vector extracting circuit 40. 

Fig. 6 Is a block diagram showing a specific arrangement of the reverse quantization circuit 100 In Fig. 

5. . . 

An output r(DC) from the variable-length decoding circuit 70 Is outputted as a reverse quantization 
output s(DC) as it is. and is given also to an adder 101. The outputs r(4 x 4) and r(8 x 8) from the variable- 
length decoding circuit 70 are given respectively to reverse quantization units 102 and 104. The reverse 
quantization unit 102 reversely quantizes the decoding output r(4 x 4) of the hierarchy 4 x 4 to give the 
same to the adder 101. The adder 101 adds the output from the reverse quantization unit 102 and the 
decoding output r(DC) of the hierarchy 2 x 2 to each other to output the same as the reverse quantization 
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output s(4 X 4) of the hierarchy 4 x 4 and to give the same also to an adder 103. The reverse quantization 
unit 104 reversely quantizes the decoding output r(8 x 8) to give the same to the adder 103. The adder 103 
adds the reverse quantization output and the reverse quantization output s(4 x 4) of the hierarchy 4 x 4 to 
each other to output the same as the reverse quantization output s(8 x 8) of the hierarchy 8x8. 
6 The reverse quantization outputs of the respective hierarchies of the reverse quantization circuit 100 are 
given to a reverse DCT circuit 105. The reverse DCT circuit 105 processes, in reverse DCT. the reverse 
quantization output every hierarchies to return the same to the original code to thereby output the same to a 
terminal a of a switch 36 and an adder 38. The arrangement including the header-signal extracting circuit 37 
for extracting the header signal, the motion-vector extracting circuit 40 for extracting the motion vector, a 
70 frame memory 41 for delaying the output signal during a single frame period of time, the adder 38 for 
adding the output form the reverse DCT circuit 105 and an output from a prediction decoding circuit 106 to 
each other to decode the inter-frame compression frame data and the switch 36 for switching the decoding 
data of the intra-frame compression data and the decoding data of the inter-frame compression data to 
output the same is similar to that of the related art in Fig. 18. The prediction decoding circuit 106 
75 compensates, In motion, for the output from the frame memory 41 by the motion vector from the motion- 
vector extracting circuit 40 to give the same to the adder 38. 

Operation of the embodiment arranged as described above will next be described with reference to 
Figs. 3(a) to 3(c) and Figs. 4(a) to 4(c). Figs. 3(a) to 3(c) are explanatory views showing a coefficient which 
performs decoding in each of the hierarchies, while Figs. 4(a) to 4(c) are explanatory views for describing 
20 operation of the embodiment. Figs. 4(a) to (c) correspond respectively to Figs. 17(a) to (c). Fig. 4(a) shows 
the hierarchy 2x2. Fig. 4(b) shows the hierarchy 4x4. Fig. 4(c) shows the hierarchy 8x8. 

The intensity signal Y and the color difference signals Cr and Cb are multiplexed In a unit of blocks of 
the eight (8) pixels x eight (8) horizontal scanning lines by the multiprocessing circuit 11 and, further, are 
multiplexed in a unit of macro blocks by four (4) blocks including two (2) intensity blocks Y and a single of 
25 each of the color difference blocks Cr and Cb and are given to the subtracter 12. Upon creation of the mtra- 
frame compression frame data, the switch 14 is turned off, and an output from the multiprocessing circuit 
11 is processed, in DCT. in the DCT circuit 13 and is outputted to the hierarchization circuit 80. 

Regarding the hierarchy 4 x 4 and the hierarchy 8x8, the hierarchization circuit 80 outputs the 
conversion coefficient of 4 x 4 of the low range and the conversion coefficient of 8 x 8 of the total region or 
30 area. Furthermore, the hierarchization circuit 80 uses only the DC component as the conversion coefficient 
of the hierarchy 2 x 2 and brings the other three (3) AC coefficients to 0 (zero) to output the same. 

The conversion coefficients d(DC). d(4 x 4) and d(8 x 8) of the respective hierarchies from the 
hierarchization circuit 80 are given to the quantization circuit 81. The quantization circuit 81 quantizes the 
conversion coefficients of the respective hierarchies and reversely quantizes the same. As the conversion 
36 coefficient output of the hierarchy 2x2, only the DC component illustrated in a diagonal portion in Fig. 3(a) 
is inputted. The quantization circuit 81 outputs DC, 0. 0 and 0 as the quantization output q(DC). Further, the 
reverse quantization output b(2 x 2) of the hierarchy 2 x 2 is also DC. 0, 0 and 0. The quantization circuit 81 
quantizes the conversion coefficient of 4 x 4 of the low range indicated by the diagonal portion in Fig. 3(b) 
in the hierarchy 4x4. Here, a DC coefficient at a left-hand diagonal portion uses a difference between the 
40 conversion coefficient from the DCT circuit 13 and the reverse quantization output (prediction value) of the 
hierarchy 2x2. The other fifteen (15) conversion coefficients use the output from the hierarchization circuit 
80 indicated in the right-hand diagonal portion as it is. Moreover, in the hierarchy 8x8. the quantization 
circuit 81 uses the conversion coefficient of 8 x 8 of the total region indicated in the diagonal portion in Fig. 
3(c). The left-hand diagonal portion in Fig. 3(c) indicates a conversion coefficient of a difference which uses, 
45 as the prediction value, the reverse quantization output from the hierarchy 4x4. while the right-hand 
diagonal portion indicates that an output from the hierarchization circuit 80 is used as it is. 

It is now assumed that the conversion coefficient from the DCT circuit 13 is one illustrated in Fig. 16. 
The hierarchization circuit 80 gives DC, 0, 0 and 0 that are conversion coefficients d(DC) of 2 x 2 of the low 
range, to the quantization circuit 81. as shown in the left-hand column in Fig. 4(a). The quantization circuit 
60 81 outputs the conversion coefficient as it is as the quantization output q(DC) and the reverse quantization 
output b(2 X 2). 

Regarding the next hierarchy 4x4. the quantization circuit 81 performs subtraction between the 
conversion coefficient d(4 x 4) and the reverse quantization output b(2 x 2) (prediction value) by the 
subtracter 85 to find a difference therebetween. The other fifteen (15) conversion coefficients use the output 
55 from the hierarchization circuit 80 as it is. The prediction value is 0 (zero), and the fifteen (15) AC 
coefficients of the hierarchy 4 x 4 are an input per se. The quantization unit 86 performs quantization by the 
quantization coefficient nine (9), as shown in Fig. 4(b). The quantization output q(4 x 4) from the 
quantization unit 86 becomes one illustrated on the central column in Fig. 4(b). The quantization output is 
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reversely quantized by the reverse quantization unit 87 and. thereatter. is added to reverse quantization 
output b(2 X 2) by the adder 88. Thus, there is provided the reverse quantization output b(4 x 4) on the 
riaht-hand column in Fig. 4(b). ^. ^. . . 

Regarding the next hierarchy 8 x 8. the quantization circuit 81 subtracts the reverse quantization output 
b{4 X 4) of the hierarchy 4 x 4 from the conversion coefficient d(8 x 8) from the hierarchization crcu, 80 by 
the subtracter 89. to give the same to the quantization unit 90 (left-hand column .n F.g. 4(c ). The 
quantization unit 90 performs quantization by the quantization coefficient four (4) to produce the quantization 
output q(8 X 8) on the central column in Fig. 4(c). Further, the quantization output q(8 x 8) is reversely 
quantized in the reverse quantization unit 91. The reverse quantization output and the reverse quantization 
output b(4 X 4) of the hierarchy 4 x 4 are added to each other in the adder 92 to produce the reverse 
Quantization output b(8 x 8) (right-hand column in Fig. 4(c)). . . 

The quantization outputs q(DC). q(4 x 4) and q(8 x 8) from the quantization circuit 81 are given to the 
variable-length coding circuit 52. The reverse quantization outputs b(2 x 2). b(4 x 4) and b(8 x 8) become 
the original data of the local decoding signal. Moreover, the reverse quantization output b(8 x 8) is given to 
the reverse DCT circuit 22 in order to create a reference image upon inter-frame compression. 

The variable-length coding circuit 52 codes, in variable length, the quantization outputs frorri the 
respective hierarchies. For example, the variable-length coding circuit 52 codes, in two-dimensional Hafman 
data of combination of the zero-run and the non-zero coefficient of the quantization output o output the 
same as coding outputs. The coding output from the variable-length coding circuit 52 .s given to the coding 
control circuit 82. A generated code amount is counted every hierarchies. The quantization circuit 81 and 
the variable-length coding circuit 52 are controlled such that the generated code amount is contended within 
the set code arnount. The set code amount is so set as to be divided Into three (3) stages including till he 
hierarchy 2 x 2'. "till the hierarchy 4 x 4" and "till the hierarchy 8 x 8". Specifically, the coding control 
circuit 82 compares, at any time, the set code amount till the respective hierarchies and the generated code 
amount till the respective hierarchies with each other to decide the quantization width m the hierarchy 4 x 4 
and the hierarchy 8 x 8. to thereby control the quantization circuit 81. Thus, the quantization coefficients o 
The quantization units 86 and 90 of the quantization circuit 81 are suitably set so that code-amount control of 
the hierarchy 4 x 4 and the hierarchy 8 x 8 is perfomied. 

Meanwhile the reverse quantization output from the quantization circuit 81 is fed back to the subtracter 
12 through the reverse DCT circuit 22. the adder 23. the variable delay circuit 24. the motion correcting 
circuit 25 and the switch 14 so as to be delayed during the period of time of a single frame Upon creation 
of the inter-frame compression frame data, the subtracter 12 subtracts data of the P^^^'^^^^^^'^ViTtJ! 
output from the multiprocessing circuit 12 to output a difference therebetween to the DCT circuit 13^ The 
difference data are reduced in data rate by the DCT circuit 13 and the quantization circuit 81 . and are 
converted to a variable-length code by the variable-length coding circuit 52. The vanable-length code is 

°"'?etnwhile. on the side of decoding, the coding output is given to the variable-length decoding circuit 
70 throuQh the code buffer memory circuit 32. The variable-length decoding circuit 70 performs variable- 
lenqth decoding every the hierarchies of the coding output. The variable-length decoding circuit 70 returns 
the ziq-zag scanning to the original matrix scanning to give the same to the reverse quantization circuit 100. 
The reverse quantization circuit 100 reversely quantizes the variable-length decoding output to reversely 

^'^The reverse quantization circuit 100 has no AC coefficient component regarding the decoding output r- 
<DC) of the hierarchy 2x2. Accordingly, the reverse quantization circuit 100 outputs the decoding output r- 
DC of the hierarchy 2 x 2 as the reverse quantization output s(DC) as it is without reverse quantization. In 
he hierarchy 4 x 4 and the hierarchy 8x8. the low-range coefficient is predicted by the use of the reverse 
Quantization output of the hierarchy 2 x 2 and the hierarchy 4 x 4 upon coding. For this reason, the 
decodina output r(4 x 4) of the hierarchy 4 x 4 has been reversely quantized by the reverse quantization 
unit 102 and thereafter, is added to the reverse quantization output s(DC) in the adder 101. whereby the 
reverse quantization output s(4 x 4) is produced. Furthermore, the decoding output r(8 x 8) is reversely 
Quantized by the reverse quantization unit 104 and. thereafter, is added to the reverse quantization output s- 
(4 X 4) by the adder 103 to produce the reverse quantization output s(8 x 8). The reverse quantization 
circuit 100 outputs an output in accordance with the received hierarchy, the hierarchy intended to be 
displayed and the like, of the reverse quantization outputs s(DC), s(4 x 4) and s(8 x 8). . , , 

in a case where the reverse DCT circuit 105 processes, in reverse DCT, the reverse quantization output 
of the hierarchy 2 x 2 or the hierarchy 4 x 4, the reverse DCT circuit 105 processes the high-range AC 
component having no effective data as 0 (zero). For example, in the hierarchy 2 x 2. the reverse DCT circuit 
100 brings three (3) AC coefficients other than the DC coefficient to 0 (zero) and handles the same as the 
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coefficient of 2 x 2. to perform the two-dimensional reverse DOT processing of 2 x 2. Further in a case 
where the reverse DCT circuit 72 uses the inputted coding output to smali-image-plane display, the reverse 
DCT Circuit 72 performs the DCT processing on the basis of the dimension of the .mage plane 
corresponding respectively to the hierarchies. Moreover, in this case, the prediction decoding circuit 106 
periorms prediction decoding in accordance with the displayed image plane size. Thus, the coding output 
which is created by the coding apparauts in Fig. 1 is decoded. 

The number of code words in the respective hierarchies will next be described. 

AS described previously, in the hierarchy 2 x 2 that is the first layer, the AC component 'S "ot coded^ 
but only the DC component is decoded. Specifically, even in a case where the set code amount of the fir^ 
layer is a value approximate to the number of bits of the required information other than the image 
information and the power of the low-range AC component is large, the minimum rating of the firj layer 
becomes possible. In this manner, the generated code amount up to the hierarchy 2 x 2 is ^ma^^- -^.i e the 
code amount capable of being used in hierarchies subsequent to the hierarchy 4 x 4 's ^^la^^^^ '^^^ 
Accordingly, it is possible to reduce the quantization error subsequent to the hierarchy 4 x 4. and it is 
possible to improve the image quality of the reproduced image on the basis of the hierarchies subsequent 

*°*Tntrresent' embodiment, with respect to the conversion coefficient in Rg. 16. the coding control 
circuit 82 is arranged such that the quantization coefficient in the hierarchy 4 x 4 is set to nine (9) which is 
smal er than that in Fig. 17. In the hierarchy 4 x 4. the code of the AC coefficient which is coded in variable 
sma ier inan ma, y m. {1} and {1}. Specifically, the number of code 

:ol'o^Je\c^Sin? w^ uVt'o^hl LloUy 4 x 4 is eleven (11^ 

code of the AC coefficient which is coded, in variable length, in the hierarchy 8 x 8 is {(0x2). - 1}. {1}. {i}. 
X) 1} {2}. {(0x2). 1}. {0, 1}. {1}, {1}. {1}. {1}. {1}. {1} and {(0x2), 1}. The number of code words 
finsmitted up to the hierarchy 8 x 8 is tienty-five (25). Specifically, it is possible to reduce the number of 
code words only by three (3) as compared with the example in Fig. 17. 

InTs maLe' in the'present embodirr,ent. the arrangement is such that the rate conUo J not 
oerformed in the first layer, but only the information required to the minimum for reproduction other than the 
ir^lT^nforlSon on the l^asis of the AC coefficient is transmitted. Thus, the code amount in the first layer 
rS^cfed 0 suppressed to the minimum, and the number of code words transmitted in the lower layer 
L hierarchy on the side of the high range) subsequent to the first layer is reduced, to improve the cod ng 
eSLncy. Moreover, since the code amount capable of being used in the lower 'av^^. ^"'^^^•^f . fj^^^ 
first layer increases, it is possible to set the quantization width small in these hierarchies. Thus, it is a^so 
possibte to reduce the quantization error to improve the image quality of the reproduced image correspond- 

'"^ Cthe^Z 'fhe arrangement is such that, upon the inter-frame compression, the motion vector which is 
used for motion compensation is also coded and is transmitted together with the inter-frame compression 
Se in this case, there is a case where the code amount of the motion vector increases remarkably as 
cZ;a"ed with the code amount of the inter-frame compression code. In view of this, it is also considered 
S?h's codramount of the motion vector is monitored to determine or decide a code transmitted by the 
firstlayerinaccordancewiththecodeamountof the motion vector. ♦wc n«in» m 

Fiq 26 is a block diagram showing a coding apparatus in which consideration is made to this point. In 
Fig 26 the same or identical reference numerals are applied to constitutional elements the same as or 
identical with those shown in Fig. 1 . and the description thereof will be omitted. 

rmodmcation illustrated in Fig. 26 is different from that shown in Fig. 1 in that a size or dimension 
(maonitude) measuring unit 83 and a comparator 84 are added. Specifically, a motion vector from a mot on 
d3ng c rcu« 26 is given to a motion correcting circuit 25, and Is also given to the dimension measuring 
jr^\Tdimension measuring unit 83 finds a mean value of the dimension of the mo on vector every 
framS to give the same to the comparator 84. A predetermined threshold value ,s ateo 9-ven to the 
comparator 84. The comparator 84 compares the threshold value and a mean value <>' th« ^^on ^^^^ 
^?th each other to actuate a hierarchization circuit 80 in a case where the mean value of the motion vector 
Ts higher than the threshold value. In a case where the mean value of the motion vector is not higher than 
L threshold value, the comparator 84 activates the hierarchization circuit 80 similarly to the hierarchization 

li! t^hVSlpparls arranged in this manner, the mean value of the dimension of the motion vector 
i is found by the dimension measuring unit 83. The comparator 84 compares the mean dimension of the 
motion vector and the predetermined threshold value with each other to activate the hierarchizatKjn circuit 
mTa Ze Where the mean value of the dimension of the motion vector is higher than the threshoW value 
to bring the alternate-current component to 0 (zero) at the hierarchy 2 x 2. to thereby output DC, 0. 0 and 0. 
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nent of the hierarchy 2 x 2 as they are. hierarchv 2x2. it is possible to 

Thus, in a case where there is a room in the code ^^o^ ^^^^ S^Lage quality is deterio- 
prevent the alternate-current component from being not transmitted so a m » 

^ig. 7 is a bloc, diagram showing an another emb^i.^^^^^^^ l^J^^^^TZZ 
identical reference numerals are applied to 

illustrated in Fig. 1. and the description 7^^°^^;" ''^^ J'X.r^^^^^^^^^^ code amount up to a lower layer 
where a relatively large code amount is allocated to a first layer, 

subsequent to the first layer is relatively sm^ , hierarchization circuit 50. The hierar- 

A conversion coefficient from a DCT circuit 9'"; . ^.,^^.uit ^ pig. 13 and outputs the 

chization circuit 50 is the same in arrangemen the hie^^^^^^^^^^ ^'^^"'^ ^ ^ ^ ^ 

conversion coefficient in division into ^^^^^^Z^) h^era ch^ fn arrangemen? as the quantization 

range and 8 x 8 of the total range. ^ , Quantization a^^^^^^^ 9 ^^^^.^^^.^^ 

circuit 51 in Fig. 14. The arrangement ,s such that ^^^e '^^^^^^ ^y a quantization-width correcting 

58 and 62 (refer to Fig. 14) of the respec^ve ^--^^^^^^^^ quantization outputs q(2 x 

circuit 111 to be described subsequently. The quantization c'rcu^Si P M ^^^^^^ ^ ^ ^ 

Tcl? in vlia\.r:i°r r;^^^^^^^^^ q^ant^vroJrS th£.spectiv^e hierarchies from the 
rnSon circuit 51 to output -ding o^ut^^^^^^^^^^^^ 

A coding output from the var.able-length coding ^^1;"'* ^-^^^^^ ^^^^ hierarchies to control the 
The code amount (generated code amount of he ^ code To^^ not exceed the set code 
variable-length coding circuit 52 such '^^V^? *° f every hierarchies in 

rlc^e-t^ ^-^^^r: r r/cr to outp. the same to the 

— :Str^^^^^ 

hierarchies given from the code-amount control circuit ' ^^'^J^^^^^^^^^ smaller than the 

width of a hierarchy on the side of the -;-9J^<;,JJX than a predetermined 

quantization width of a hierarchy on he ^ide of the high ^a"9^ J quantization width of the 

threshold value, the quantization-width width such that a 

; hierarchy on the side of the low range -''^^^J ^^^^^ and the quantization 

" OpSn of the embodiment arranged in this manner will ne^ ^ ^^^^^^ ^.^ ,^ 3, 33 ,0 
,t is assumed that the set code amount up to the ^-era^f V 2/ J ^.^V 3lunt^ u^^^^^^^ hierarchy 4 x 
have a large and sufficient room, -^j;,^;^^^^^^^^^^^ th^ set code amount of 

4 and the set code amount up to the hierarchy 2x2 ^ re^^^^^V ^ , g^ount of the 

,5 the hierarchy 2 x 2 is large, the ^^^^ w,^^^^^^^ is r^any On the contrary, the code amount of the 
quantization output q(2 x 2) from t e quantization ^" '^^^^ ^^J, hierarchy 2 x 2 is 

CT^:^^::":^^ -.ng the .erarchy 2 x 2. 

and sets the large quantization width ^^Q^rding fe h.^^^^^^^^^^ ^.^^^^^^^ ^^^.^ 

,0 The quantization-width --^X'f^^^^^^^^^^^ q al to 0 more than the predetermined threshold 
larger than the quantization width of the ^^'^'^''^'^y controlling in rate, of the hierarchy 2 x 2 

va?ue. to correct the ^-ntiza« t^^^^^^^^^^^^ q,3„„,3tion unit 
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aenerated code amount of the hierarchy 4 x 4 is r,ot reduced less than the total set code annount in blocks 
?nhJI^Pnt to the block in which the quantization width is corrected. Thus, it is possible to increase the 

Se SraX 2 x 2 is reduced. K is possible to improve the Image quality of the reproduced .mage on 

rtL^'^nnHTpresent embodiment, the arrangement is such that the difference between the 
oual^on wTdth 'of the respective hierarchies is monitored, and the quantization width corrected such 
TtTe » e does not increase more than the predetermined threshold value Thus, the P^^^o" °^ 
the qua« errors of the respective hierarchies is equalized so that the image qualities of the 

Qualrn w dth o the hierarchy 2 x 2 and'the quantization width of the hierarchy 4 x 4 is so corrected js 
rbfc? tended within the threshold value, but also the quantization width of the tj.erarchy 2 x 2 and the 
Quantizatton width of the hierarchy 4 x 4 are so corrected as to become the same value. 

Fif 8 tea block diagram showing an another embodiment of the invention. In Fig 8 the same or 
' idenS ^elerencfnurals are appllL to constitutional elements the same as or identical with those in 

'^■irtl^Z'tt^^ that, regarding the hierarchy In which the code amount 
decrease In th^e code amount of the hierarchy on the side of the high range which is generated by 

. „7 to rSeSL subse<^»n,l,. The »,an9em« s«h .ha, a ^ <,>.«-t.a„on o>*pu. ol .he 

man fcTet wde amoum .he fluamizaOoh-wM, reaxaminafch drcui. ,17 reduces , he quanKa,»n 
:ir,hrhrarcCo cause i« geUed code a™„n, up ,0 ,he^^ 

=ih^eSrcS,vr;r'rc::=^^^ 

^J:Z Jls o, *: ,eepe*e h,e.,ch, . x h.ra.h, 4 x 4 
s«l «,e se. code amoun. up B «,e hierarchy 2 x2 ^ °™ ^ , amerence M»een .he 

r*rrru"rro." risrc. r ^ - ^ ^ereo, 

one sZn in Fig. 20. In the predetermined block, similarly to the embodimen in Fig. 7. since set code 
n n^rtho h?«rarchv 2 x 2 is larqe or high, the quantization width of the hierarchy 2 x 2 is small or low 
ITamr^o^ l: qu:nSn out^put q(2'x 2) is large or great. On the contrary, the code amount 
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of the quantization output q(4 x 4) is small. Thus, the quantization width set by the code-amount control 
circuit 18 is assumed to become a difference greater or larger than the predetermined threshold value at 
the hierarchy 2 x 2 and the hierarchy 4x4. Then, the quantization-width correction circuit 111 increases the 
quantization width of the hierarchy 2 x 2 to quantize the conversion coefficient (Fig. 20) of the subsequent 

block. 

For example, it is assumed that the conversion coefficient of the hierarchy 2x2 indicated on the left- 
hand column in Fig. 9(a) is quantized by ten (10). The quantization output q(2 x 2) in this case becomes 
one illustrated on the central column in Fig. 9(a), Specifically, the code which is coded, in vanable length, 
up to the hierarchy 2 x 2 is DC. 8, 11 and 6. Specifically, as compared with the conventional example, 
power of the AC coefficient after quantization becomes extremely small, and becomes the code amount 
which is considerably or remarkably reduced less than the setting rate. The quantization circuit 115 
performs quantization regarding also the following hierarchies 4 x 4 and 8 x 8. to output the quantization 
output to the variable-length coding circuit 116. The variable-length coding circuit 116 codes, in vanable 
length, the quantization outputs of the respective hierarchies to output the coding outputs to the quantiza- 
tion-width reexamination circuit 117. 

The quantization-width reexamination circuit 117 monitors the generated code amount of the coding 
outputs In this case, since the quantization width of the hierarchy 2x2 increases by correction without 
performing rate control, the code amount which is generated up to the hierarchy 4 x 4 is lower or smaller 
than the set code amount. In view of this, the quantization-width reexamination circuit 117 gives a command 
or indication to the quantization circuit 118 so as to decrease the quantization width of the hierarchy 4x4. 
For example, it is assumed that fifteen (15) is set as the quantization width of the hierarchy 4x4. The 
quantization circuit 118 quantizes the hierarchy 2 x 2 by the quantization coefficient ten (10), while 
quantizes the hierarchy 4 x 4 by the quantization coefficient fifteen (15). 

Thus, the quantization circuit 118 outputs the coefficient illustrated on the central column in Fig. 9(b) as 
the quantization output of the hierarchy 4x4. Specifically, the AC coefficient coded, in variable length, in 
the hierarchy 4 x 4 becomes {(0x3). 3}. {0. 2}. {1}. {2}. {2}. {1}. {1}. {1}, {1} and {1}. 

Moreover, the quantization outputs q(8 x 8) in the hierarchy 8x8 becomes one shown in the central 
column in Fig. 9(c). The AC code which is coded, in variable length, in the hierarchy 8 x 8 is {0. 1}, {(0x4). 
1}. {0, 1}. {2}. {- 1}. {0. ■ 1}. {1}. {1}. 0}. {- 1}. {1}. {n. {(0x2). 1}. {0. 1} and {1}. As will be clear 
from comparison with the conventional example, since the power of the AC coefficient for coding is 
reduced, it is possible to shorten a code length. 

In this manner, in the present embodiment, the quantization width is corrected, whereby the power of 
the AC coefficient can decrease, and the entropy can be reduced. It is possible to remarkably reduce the 
quantization error in the hierarchy 4x4 less than the conventional example, and it is possible to improve 
the image quality of the reproduced Image on the basis of the hierarchy 4x4. Further, it is possible to 
equalize the quantization error to equalize the image qualities of the respective hierarchies. 

Fig. 22 is a block diagram showing an another embodiment of the invention. In Fig. 22. the same or 
identical reference numbers are applied to constitutional elements the same as or identical with those in 
Fig. 1, and the description thereof will be omitted. The present embodiment is so considered as to project 
or represent an image on the basis of the hierarchy 2x2 that is the first layer. 

The present embodiment is different from the embodiment in Fig. 1 in that the present embodiment 
comprises a motion-vector degeneration circuit 121 and a variable-length coding circuit 122. A motion 
vector from a motion detecting circuit 26 is given to a motion correcting circuit 25. and is given also to the 
motion-vector degeneration circuit 121. The motion-vector degeneration circuit 121 is so arranged as to 
reduce the motion vector in accordance with the hierarchy. As described previously, if the coding output 
using only the low range of the conversion coefficient is decoded, the reproduced image becomes a 
reduced image. In a case where the reproduced image is used as it is and is displayed in small image 
plane, it is required that, when the coding output is compressed in inter-frame, the motion vector is reduced 
in accordance with the reduction ratio to perform motion correction. Meanwhile, if the reproduced image is 
displayed in total region of the Image plane, that is, in dimension corresponding to the hierarchy 8x8. the 
displayed image is low in resolution. In this case, detailed information is not required as the motion vector. 
In view of this, in the present embodiment, the motion vector is reduced on the side of coding and is 
transmitted, whereby the coding efficiency is improved. In a case where the coding output of the upper 
layer is used to perform display in small image plane, the reduced motion vector is used as it is. while, in a 
case where display Is performed in large image plane, the motion vector transmitted is enlarged and is 
used. 

Fig. 23 is a block diagram showing a specific arrangement of the motion-vector degeneration circuit 121 
in Fig. 22. 
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The original motion vector from the motion detecting circuit 26 is given to a memory 131. The memory 
131 preserves the motion vector inputted at timing the first layer is coded, until coding of the subsequent 
layer is performed, to output the same to a divider 132. Kinds or types of the hierarchies are also inputted 
to the divider 132. The divider 132 divides the motion vector by a value in accordance with the type of the 

5 hierarchies, that is, a value in accordance with a ratio between the number of the conversion coefficients In 
the horizontal and vertical directions In the first layer (the hierarchy on the nearest side of the high range)- 
(hereinafter referred to as "full DCT size") and the number of the conversion coefficients in the horizontal 
and vertical directions in the respective hierarchies (hereinafter referred to as "DCT size") to output the 
same to a switch 133 and a memory 136. For example, it is assumed that the hierarchies of coding are the 

70 hierarchy 2x2, the hierarchy 4 x 4 and the hierarchy 8x8. Then, the divider 132 performs division by (full 
DCT size/DCT size = ) 8/2 = 4 at the hierarchy 2x2, and performs division by 8/4 = 2 at the hierarchy 4 
X 4. Moreover, at the hierarchy 8 x 8, 8/8 = 1 so that division is not performed. 

In the present embodiment, the image quality of the reproduced image on the basis of the coding 
output of the hierarchy on the side of the high range is considered to transmit the motion vector every the 

75 hierarchies. In this case. In order to reduce the coding amount, the motion vector is predicted in difference 
at the hierarchies other than the first layer and is outputted. Specifically, the switch 133 gives the output 
from the divider 132 to an output terminal 134 at the first layer, and gives the output from the divider 132 to 
a subtracter 135 other than the first layer. The memory 136 outputs the output from the divider 132 to a 
multiplier 137 upon coding of the subsequent hierarchy. The kinds of hierarchies are also given to the 

20 multiplier 137. The multiplier 137 multiplexes (DCT size of the DCT size of the present layer/the previous 
layer (the hierarchy on the side of the low range)) to an output from the memory 136 to find a prediction 
value, to thereby output the same to the subtracter 135. The subtracter 135 subtracts the prediction value 
from the reduced motion vector from the divider 132 to output the difference therebetween to the output 
terminal 134. 

25 The reduced motion vector is given to the variable-length coding circuit 122 through the output terminal 
134. The variable-length coding circuit 122 codes, in variable length, the reduced motion vector to output 
the same. 

Fig. 24 is a block diagram showing a motion-vector reproducing circuit which is used in the motion- 
vector extracting circuit (refer to Fig. 5) on the side of decoding. In this connection. Fig. 24 shows a circuit 

30 in a case where the small-image-plane display is performed. 

The motion vector of the hierarchy 2 x 2 is used as it is. The coding outputs of the motion vectors of 
the hierarchy 2x2, the hierarchy 4x4 and the hierarchy 8 x 8 are given respectively to a multiplier 151, 
and adders 152 and 154. (DCT size/DCT size of the hierarchy on the side of the low range =) 4/2 = 2 is 
also given to the multiplier 141. 2 is multiplied to the motion vector of the hierarchy 2 x 2 to find a 

35 prediction value to thereby output the same to the adder 152. The adder 152 adds the coding output 
(difference value) of the motion vector of the transmitted hierarchy 4x4 and the prediction value to each 
other to reproduce the motion vector of the hierarchy 4 x 4. to thereby output the same. 

The output from the adder 152 Is given also to a multiplier 153. (DCT size/DCT size of the hierarchy on 
the side of the low range =) 8/4 = 2 is also given to the multiplier 153. 2 is multiplied to the motion vector 

40 of the hierarchy 4 x 4 to find the prediction value, to thereby output the same to the adder 154. The adder 
154 adds the coding output (difference value) of the transmitted motion vector of the hierarchy 8x8 and 
the prediction value to each other to reproduce the original motion vector of the hierarchy 8 x 8. to thereby 
output the same. 

Operation of the embodiment arranged in this manner will next be described. 

45 The motion vector from the motion detecting circuit 26 is given to the motion-vector degeneration circuit 
121 and is reduced by a reduction ratio which is in accordance with the layer. Now, It is assumed that 
dimension or size of the motion vector from the motion detecting circuit 26 is ten (10). The memory 131 
preserves the motion vector which is inputted upon coding of the hierarchy 2x2 that Is the first layer, till 
the time of coding of the hierarchy 4 x 4 of the subsequent layer, to give the same to the divider 132. 

60 In the hierarchy 2x2, the divider 132 divides the motion vector by (full DCT size/DCT size =) 8/2 = 4 
to output the same. In this connection, for convenience of description, the division result of the divider 132 
is shown in half-adjustment. Specifically, 10/4 3 (- indicates a value in which a quotient is half-adjusted 
at equal to or less than a decimal point) is outputted from the divider 132. The switch 133 outputs the 
output from the divider 132 to the output terminal 134 as it is upon coding of the first layer. This motion 

55 vector is processed. In PCM, by a difference with respect to the adjacent block, for example, and is given to 
the variable-length coding circuit 122. Moreover, the motion vector ("3") of the hierarchy 2x2 from the 
divider 132 is given also to the memory 136 and is stored. 
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in the hierarchy 4 x 4. the motion vector ("10") from the memory 131 Is divided by ( u I DCT s.ze/DCT 
size =1/4 = 2 at the divider 132. The divider 132 outputs 10/2 5 to the switch 133- At layers other than 
Tfirs layer, the switch 133 gives the output from the divider 132 to the subtracter 135. Mea";^' j^e 
mul iS 137 reads out the motion vector ("3") of the hierarchy 2 x 2 that is the hierarchy on the side of 
the low ^ ge. from the memory 136 to multiply (DCT size/DCT size of the hierarchy on the side of he low 
anae (the hierarchy 2 x 2) =) 4/2 = 2. to thereby find a prediction value. The multiplier 137 gives he 
o nd predicL vaL (3 x 2 = 6) to the subtracter 135. The subtracter 135 subtracts the prediction value 
the motion vector of the hierarchy 4 x 4 from the divider 132 to output a difference therebetween. - 1 
i~ 5 - 6^ is outDutted from the subtracter 135. . . u *u ^- vi 

^ m the hle^chy 8 x 8. the motion vector ("10") Is given to the subtracter 135 as it .s through the divider 
132 and the switch 133. The multiplier 137 multiplies (DCT size/DCT size of the hierarchy on the side of the 
ow rang^the hierarchy 4x4)) = 8/4 = 2 to the output (reduced vector value -5") from the d.vider 132 of 
he Schy 4 X 4 whL is read out from the memory 136. to find a prediction value. The subtracter 1^ 
subt"e prediction value (5x2 = 10) from the motion vector ("10") to output the same. Specifically. 

the subtracter 135 outputs a difference 0 (zero) (=10-10). h;or=.rrhw 9 v ? whereas in 

In this manner, conventionally, the motion vector ("10") Is transmitted in the hierarchy 2 x 2. whereas, in 
the present embodiment, the motion vector ("3") reduced should be transmitted up to the hierarchy 2 x 2^ 
ihus i is possible to reduce the code amount. Furthermore. ^^S^^^.'^S . * V^'^'^^^ ^ If 
hiera chy 8 x 8. only a difference value is transmitted. Since hierarchization .s performed at the hierarchy 2 
X 2 Ihe hierarchy 4 x 4 and the hierarchy 8 x 8. the difference value regarding the hierarchy 4 x 4 and the 
hiorarchv 8 x 8 is any of 0, 1 and -1 . It is possible to reduce an increase in the code amount. 

The out ut ^m the motion-vector degeneration circuit 121 is given to '^l^.^'^^'^^^^''^^'^^^ 
122 Since the difference value of the hierarchy 4 x 4 and the hierarchy 8 x 8 is any one of three (3) kinds 
induding 0 1 and -1. the variable-length coding circuit 122 allocates the variable-length codes illustrated m 
the below table 2. for example, whereby It Is possible to perform coding of high efficiency. 

Table 2 



30 



35 



40 



45 



60 



55 



Difference 


Code 


0 


0 


1 


10 


-1 


11 



Operation on the side of decoding will next be described. 

kTs assumed that small-image-plane display is performed which uses the coding output of he 
hierarchy 2 X 2. in ,his case, since the motion vector is reduced in accordance with the DCT size on the 
codinq side, the transmitted reduced motion vector ("3") should be used as it is. 

! is a sumed that small-image-plane display is performed which uses ^"'^■"S ""^P"* °* f/^ 
hierarchy 4 X 4. The reduced motion vector of the hierarchy 2 x 2 Is given to the multiplier 161 wh ch 
perms miiplication such as (DCT size/DCT size of the hierarchy on the side of the range (the 
Sa chy 2 X 2)) = 4/2 = 2 to restore a prediction value (3x2 = 6). The adder 152 adds the transmitted 
Silence value of the hierarchy 4 x 4 and the prediction value to each other to find the reduced motion 

a ctst l^e^Tc'o^pV^f the hierarchy 8 x 8 Is used to perform display over the en«re 
regi n of'^'e Tmie plane, the' output from the adder 154 is used. The 

size/DCT size of the hierarchy on the side of the low range (the hierarchy 4 x 4) =) 8/4 - 2 to the reduced 
n^^ln vecto ^S") of the hierarchy 4 x 4. to restore the prediction value (5x2 = ^OUo^Uerety g^e he 
Tal to 'he adder 154. The adder 154 adds the difference value ("0") of the transmitted hierarchy 8 x 8 
an? the prediction value ("10") to each other to reproduce the motion vector ("10"). to thereby output the 

^^""pig. 25 is a block diagram showing the motion-vector reproducing circuit in a case where the large- 

'"'^Tte '"d'uS^^^^^^ the hierarchy 2 x 2. the hierarchy 4 x 4 and the hierarchy 8 x 8 and the 

diffeLncrSalue are given respectively to a multiplier 141 and adders 143 and 146Jfull DCT s.ze/DCT s,ze 
= ) S = 4 is also given to the multiplier 141. 4 is multiplied to the reduced motion vector o the 
transmitted hierarchy 2 x 2 to reproduce the original motion vector. The reduced motion vector of the 
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hierarchy 2 x 2 is also given to a multiplier 142. (DCT size/DCT size of the upper layer =) 4/2 = 2 is also 
given to the multiplier 142. 2 is multiplied to the reduced motion vector of the hierarchy 2 x 2 to restore the 
prediction value, to thereby give the same to the adder 143. The adder 143 adds the prediction value to the 
difference value of the transmitted hierarchy 4 x 4 to find the reduced motion vector of the hierarchy 4 x 4, 
to thereby output the same to multipliers 144 and 145. (full DCT size/DCT size =) 8/4 = 2 is also given to 
the multiplier 144. 2 is multiplied to the reduced motion vector of the hierarchy 4 x 4 to reproduce the 

original motion vector. „ . , * 

(DCT size/DCT size of the hierarchy on the side of the low range =) 8/4 = 2 is also given to the 
multiplier 145. 2 is multiplied to the reduced motion vector of the hierarchy 4 x 4 to find a prediction value, 
to thereby output the same to the adder 146. The adder 146 adds the difference value of the transmitted 
hierarchy 8 x 8 and the prediction value to each other to reproduce the original motion vector. 

Reproducing operation of the motion vector in a case where large image-plane display is performed will 

next be described. . u »ha 

It is assumed that the large image-plane display is performed over the entire region by the use of the 
coding output of the hierarchy 2 x 2. In this case, the multiplier 141 multiplies (full DCT size/DCT^size -) 
8/2 = 4 to the transmitted reduced motion vector ("3") and outputs the multiplication result (3x4- 12) as 
a reproduced output of the motion vector. 

The reduced motion vector of the hierarchy 2 x 2 is also given to the multiplier 142. The multiplier 142 
multiplies (DCT size/DCT size of the hierarchy on the side of the low range (the hierarchy 2 x 2) -) 4/2 = 
2 to the motion vector ("3") of the hierarchy 2 x 2 to reproduce the prediction value (3x2- 6). The adder 

143 adds the difference value (- 1) of the transmitted hierarchy 4 x 4 and the prediction value (6) to each 
other to reproduce the reduced motion vector (6 + (- 1) = 5) of the hierarchy 4 x 4. Further, the multiplier 

144 multiplies (full DCT size/DCT size =) 8/4 = 2 to the reduced motion vector ("5") to reproduce the 
original motion vector. In this manner, in a case where the coding output of the hierarchy 4 x 4 is used to 
perform the large image-plane display, the output ("10") from the multiplier 144 is used as the motion 
vector 

In a case where the large image-plane display is performed by the use of the coding output of the 
hierarchy 8x8, the output from the adder 146 is used as the motion vector. The multiplier 145 multiplies 
(DCT size/DCT size of the hierarchy on the side of the low range (the hierarchy 4 x 4) =) 8/4 = 2 to the 
reduced motion vector of the reproduced hierarchy 4 x 4 to find the prediction value (5 x 2 =^10). to 
thereby give the same to the adder 146. The adder 146 adds the prediction value ("10") to the diHerence 
value ("0") of the transmitted hierarchy 8 x 8, to output the addition result (10 + 0 = 10) as the motion 
vector 

Regarding the inter frame, the motion vector which is reproduced by the circuit in Fig. 24 or Fig. 25 is 
used to perform motion correction. j • 

In this manner In the present embodiment, th^e motion vector is reduced and is transmitted in 
accordance with the DCT sizes of the respective hierarchies. Thus, it is possible to reduce the code amount 

of the first layer. u -i 

In the present invention, it is apparent that different working modes can be arranged in a broad scope 
on the basis of the present invention without departure of the spirit and scope of the invention. The 
invention is not limited or restricted by specific working modes thereof except being limited by appended 
claims. 

Claims 

1 A coding apparatus for hierarchizing a digital signal to code the same, characterized by comprising: 

orthogonal transformation means for orthogonally transforming a digital signal to output a conver- 
sion coefficient having a direct-current component and a plurality of alternate-current components; (13) 
hierarchization means for hierarchizing the conversion coefficient from said orthogonal transforma- 
tion means into a plurality of hierarchies in accordance with a frequency of said conversion coefficient 
to successively output the hierarchized conversion coefficient from a first layer corresponding to a low- 
range component toward an nth layer (n is the integer equal to or more than 2) corresponding to a 

high-range component: (80) . 

transmission means for controlling, in rate, the conversion coefficients of the respective hierarchies 
from said hierarchization means to transmit the conversion coefficients; and (81. 82) 

rate adjusting means for inhibiting the rate control of said transmission means to control rates of 
the respective hierarchies on the basis of powers of the respective hierarchies. (80) 
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A coding apparatus according to claim 1, characterized in that said rate adjusting means reduces the 
rate of said first layer less than the rate due to control of said transmission means. 

A coding apparatus according to claim 1, characterized in that said rate adjusting means judges the 
powers of the respective hierarchies by a code amount in a case where the conversion coefficients of 
the respective hierarchies are coded. 

A coding apparatus according to claim 3, characterized in that said rate adjusting means reduces the 
rate of said first layer by said coding due to the rate control of said transmitting means. 

A coding apparatus according to claim 1, characterized in that said rate adjusting means includes rate 
non-control means for inhibiting transmission of the conversion coefficient of said alternate-current 
component regarding a conversion coefficient of said first layer of the conversion coefficients of the 
respective hierarchies which are outputted from said hierarchization means to said transmission means, 
to halt the rate control of the first layer due to said transmission means. 

A coding apparatus for hierarchizing a digital signal to code the same, characterized by comprising: 

orthogonal transformation means for orthogonally transforming a digital signal to output a conver- 
sion coefficient having a direct-current component and a plurality of alternate-current components; (13) 

hierarchization means for hierarchizing the conversion coefficient from said orthogonal transforma- 
tion means into a plurality of hierarchies in accordance with a frequency of said conversion coefficient 
to successively output the hierarchized conversion coefficient from a first layer corresponding to a low- 
range component toward an nth layer (n is the integer equal to or more than 2) corresponding to a 
high-range component; (80) 

quantization means for quantizing the conversion coefficients of the respective hierarchies to output 
a quantization output; (81) 

variable-length coding means for converting said quantization output to variable-length codes every 
hierarchies; (52) 

rate control means for monitoring an output code amount of said variable-length coding means to 
control a quantization coefficient of said quantization means every hierarchies, to thereby perform rate 
control every hierarchies; and (82) 

rate adjusting means including rate non-control means for inhibiting transmission of the conversion 
coefficients of said alternate-current components, regarding the conversion coefficient of said first layer, 
of the conversion coefficients of the respective hierarchies outputted from said hierarchization means to 
said quantization means. (80) 

A coding apparatus according to claim 6, characterized in that said rate adjusting means includes 
quantization-width correcting means for correcting a quantization width of said predetermined hierarchy 
so as to be within a predetermined threshold value in a case where a quantization width of a 
predetermined hierarchy of quantization widths set by said rate control means is smaller than the 
quantization width of a lower layer therebelow equal to or less than said threshold value, to increase the 
same. 

A coding apparatus according to claim 7, characterized in that said rate adjusting means includes 
quantization-width reexamination means for monitoring an output from said variable-length coding 
means in a case where a quantization width corrected by said quantization-width correcting means is 
used, to correct so as to reduce the quantization width of a hierarchy below the predetermined 
hierarchy in which said quantization width is corrected on the basis of a monitoring result, to thereby 
again quantize the same. 

A coding apparatus for hierarchizing an image signal to code the same, characterized by comprising: 

motion detecting means for detecting motion of an image from an inputted image signal, to output 
a motion vector; (26) 

orthogonal transformation means for orthogonally transforming said image signal to output a 
conversion coefficient having a direct-current component and a plurality of alternate-current compo- 
nents; (13) 

hierarchization means for hierarchizing the conversion coefficient from said orthogonal transforma- 
tion means into a plurality of hierarchies in accordance with a frequency of said conversion coefficient 
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to successively output the hierarchized conversion coefficient from a first layer corresponding to a low- 
range component toward an nth layer (n is the integer equal to or more than 2) corresponding to a 

high-range component; (80) 

quantization means for quantizing the conversion coefficients of the respective hierarchies to output 

a quantization output; (81) , . ■ 

reference-image creating means for reversely quantizing said quantization output to reversely 
orthogonally converting the same, to thereby produce a reference image; (81), (22) 

prediction means for correcting, in motion, said reference image by the use of said motion vector 
to find a difference between said reference signal and an image signal, to thereby give a found 
difference to said orthogonal transmission means to predict and code the same; (25). (12) 

rate control means for monitoring a code amount of the prediction coding output due to said 
prediction means to control the quantization coefficient of said quantization means every hierarchies, to 
thereby perform rate control every hierarchies; and (82) 

rate adjusting means for predictively coding only the code of said motion vector and said direct- 
current component regarding said first layer by said coding due to rate control of said transmission 
means on the basis of a code amount of prediction coding outputs of the respective hierarchies. (80) 

10 A coding apparatus for hierarchizing an image signal to code the same, characterized by comprising: 

motion detecting means for detecting motion of an image from an inputted image signal, to output 

a motion vector; (26) . . • ■ * „ .*^..4 « 

orthogonal transformation means for orthogonally transforming said image signal to output a 
conversion coefficient having a direct-current component and a plurality of alternate-current compo- 

Werachization means for hierarchizing the conversion coefficient from said orthogonal transforma- 
tion means into a plurality of hierarchies in accordance with a frequency of said conversion coeKicient 
to successively output the hierarchized conversion coefficient from a first layer corresponding to a low- 
range component toward an nth layer (n is the integer equal to or more than 2) corresponding to a 

high-range component; (80) ... u- . . ♦ 

quantization means for quantizing the conversion coefficients of the respective hierarchies to output 

a quantization output; (81) 

reference-image creating means for reversely quantizing said quantization output to reversely 
orthogonally converting the same, to thereby produce a reference image; (81). (22) 

prediction means for correcting, in motion, said reference image by the use of said motion vector 
to find a difference between said image signal and said reference image, to thereby give a found 
difference to said orthogonal transmission means to predict and code the same; and (25), (12) 

motion-veclor reducing means for reducing said motion vector every hierarchies on the basis of a 
ratio between the number of conversion coefficients of said nth layer and the number of the conversion 
coefficient of each of said hierarchies, to find a reduced motion vector, to thereby code the found 
reduced motion vector to output the same together with a quantization output of each of said 
hierarchies. (121) 

11 A coding apparatus according to claim 10, characterized in that the reduced motion vector of each of 
' the layers subsequent to a first layer performs prediction by the use of the reduced motion vector of an 

upper layer and a ratio of number between the number of conversion coefficients of the upper layer, 
and the number of conversion coefficients of a hierarchy which is coded at present to code, in 
difference, the same. 

12 A coding apparatus according to claim 11. characterized by including rate adjusting means for coding 
in prediction, only the reduced motion vector and said direct-current component regarding the first 
layer. 

ia A coding apparatus for hierarchizing an image signal to code the same, characterized by comprising: 

motion detecting means for detecting motion of an image from an inputted image signal, to output 

a motion vector; (26) ^ « 

orthogonal transformation means for orthogonally transforming said image signal to output a 
conversion coefficient having a direct-current component and a plurality of alternate-current compo- 

We?archization means for hierarchizing the conversion coefficient from said orthogonal transforma- 
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tion means into a plurality of hierarchies in accordance with a frequency of said conversion coeffic ent 
0 successively output the hierarchized conversion coefficient from a first layer ^'^'^'^^^^^lo o ^ 
range component toward an nth layer (n is the integer equal to or more than 2) corresponding to a 

^'CXZ^eTnirquantizing the conversion coefficients of the respective hierarchies to output 

means for reversely quantizing said quantization output to reversely 
orthogonally converting the same, to thereby produce a reference image: (81). (^^) 

pLction means ?or correcting, in motion, said reference signal by the use o said motion vecto to 
find a difference between said reference signal and said image sgnal. to ttiereby give a found 
difference to said orthogonal transmission means to predict and code the same; (25). (12^ 

means-value computing means for finding a mean of a dimension of said mohon vector, (B3) 
Tate adjusting means for comparing a mean value of the dimension of said "^^^<^- ^^^^^nTL^ 
predetermined threshold value, to code, in prediction, only the code of said motion vecto and sa^ 
Srect-current component regarding the first layer corresponding to low-range component m a case 
where mean magnitude of the motion vector is larger than said threshold value. (84). (80) 
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